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We study the applications of non-equilibrium relations such as the Jarzynski equality and 
fluctuation theorem to spin glasses with gauge symmetry. It is shown that the exponenti- 
ated free-energy difference appearing in the Jarzynski equality reduces to a simple analytic 
function written explicitly in terms of the initial and final temperatures if the temperature 
satisfies a certain condition related to gauge symmetry. This result is used to derive a lower 
bound on the work done during the non-equilibrium process of temperature change. We also 
prove identities relating equilibrium and non-equilibrium quantities. These identities suggest 
a method to evaluate equilibrium quantities from non-equilibrium computations, which may 
be useful to avoid the problem of slow relaxation in spin glasses. 



1. Introduction 

Equilibrium and non-equilibrium properties of spin glasses have been studied for many 
years by experimental, numerical and analytical methods. ^"'^^ Although most of the theoretical 
problems have been solved fairly satisfactorily at the mean-field level, it is still difficult to 
establish analytical results for finite-dimensional systems. Numerical approaches are powerful 
tools in finite dimensions but are often hampered by slow relaxation if one wishes to evaluate 
equilibrium quantities at low temperatures, and ingenious methods have been proposed to 
circumvent this difficulty. ^"^'^^ In particular, Neal''^ proposed annealed importance sampling, 
in which one changes the temperature and measures physical quantities in a spirit similar to 
the Jarzynski equality.^^' Hukushima and Iba®'^) improved Neal's method by incorporat- 
ing a branching process for the stability of the algorithm. Their method, which they called 
population annealing, showed outstanding performance comparable to the exchange Monte 
Carlo. 

Non-equilibrium relations such as the Jarzynski equality and fluctuation theorem^^^^^^ 
represent important developments in non-equilibrium statistical physics because they directly 
relate non-equilibrium and equilibrium quantities (Jarzynski equality) or the probability of a 
non-equilibrium process and its inverse process (fluctuation theorem) . It is the purpose of the 
present paper to apply the non-equilibrium relations to the context of spin glasses and show 
that non-trivial simplifications are observed under certain conditions on the system param- 
eters. Several additional non-equilibrium relations are also derived that connect equilibrium 
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and non-equilibrium quantities. These results are not only interesting in their own right but 
may be useful to extract information from non-equilibrium numerical simulations following 
the idea of Neal and Hukushima and Iba. 

This paper is organized as follows. In the next section, we recall the basic formulation in 
order to fix the notation and set the stage for further developments in the following sections. 
In §3, we establish several non-equilibrium relations by using gauge symmetry. In the last 
section, we give a summary of the results obtained in the present study. 

2. Formulation 



Let us consider the ± J Ising model of spin glasses on an arbitrary lattice, 

H = -'^JijSiSj, (1) 

(ij) 

where the distribution function of quenched randomness is specified as 

P{Tij) = p5{nj - 1) + (1 - p)5{Tii + 1) = (2) 

with Tij being the sign of Jij {Jij = TijJ). The parameter Kp has been defined as c^^^p = 
(1 — p)/p- The product f3J will be written as K. The following analyses can readily be ap- 
plied to other distribution functions of Jij as long as they satisfy a certain type of gauge 
symmetry. 

Suppose that the system evolves following a stochastic dynamics governed by the master 
equation. For simplicity, we will formulate our theory for discrete time steps although the 
continuous case can be treated similarly. We change the value of the coupling K from Kq at 
t = to to Kt at t = tn in n steps of time evolution, (Kq, Ki, • • • , Kn = Kt)- Correspondingly, 
the spin configuration changes as Sq (at t = tg), Si (at t = ti), ■ ■ ■ , S„ (at t = t„). These con- 
figurations will be collectively denoted as {S}. Notice that each Sj stands for a configuration 
of N spins at time t = t^. The system is assumed to be in equilibrium at t = t^. 

The fluctuation theorem ""^^"^^^ relates the probability Pkq^Kt{{'^"\) that such a sequence 
is realized with the probability Pkj.^Kq[{^^) of the inverse process as 

Pkq^Kt{{^}) -0W ^ Z{KT;{Tij}) 
Pk,^k,{{S}) Z{Ko;{n,})- 

Here W is the work done to the system during the non-equilibrium process. More precisely, 

the work for a single time step SW is defined as 

P-6W = {Ki+i - Ki)E{Si). (4) 

where E{Si) is the instantaneous energy for the spin configurations Si given by the Hamil- 
tonian (1) divided by J. The right-hand side of eq. (3) is the ratio of equilibrium partition 
functions at two different couplings with a fixed configuration of quenched randomness. 
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Equation (3) immediately leads to, for an observable 0({S}), 

0({S})e-^^) ={0.m))Kr-.K.^Ip^, (5) 

I Kq^Kt z ( a ; }) 

where Or denotes the observable which depends on the backward process Kt Kq. The 

brackets with subscript Kq — )■ Kt denote the average with the weight Pko^KtU^}) over 

possible non-equilibrium processes. For O = O,. = 1, eq. (5) reduces to the Jarzynski equal- 

ity.11.12) 

If we choose an observable depending only on the final state, which we denote by Or, 
instead of 0({S}), Or becomes an observable at the initial state in the backward process. 
Then {0^) Kt^Ko equals to the ordinary thermal average at the initial equilibrium state with 
the coupling constant Kt, to be denoted by {■ ■ ■)kt: and eq. (5) reads 

/ Ko-^Kt z ( Ao ; ) j 

3. Non-equilibrium relations on the Nishimori Line 

We now consider the application of the relations (5) and (6) to the context of spin glasses. 



3.1 Gauge-invariant quantities 



We apply the non-equilibrium relation (6) to a gauge- invariant quantity G({rij}). After 
the configurational average (to be expressed as [• ■ -jxp), wc have 

ZiKT;{Tij}) 



GT(K})e-^^) 



{G{{rij}))K, 



(7) 



Z{Ko;{n,]) 

The quantity on the left-hand side is the configurational as well as non-equilibrium averages 
of the observable G({rjj}) at final time T, that is after the protocol Kq —?■ Kt with the factor 
g-/3Vy_ ^Yie other hand, (G'({rjj}))xr on the right-hand side means the configurational and 
thermal average of the equilibrium state for the final Hamiltonian. 

Let us apply the gauge transformation Si — > SjUj, Jij — )• Jijaiaj {yi,j)}^'^'^^ The right- 
hand side of eq. (7) is then rewritten explicitly as, 



{G{{nj}))Kr 



Z{KT;{nj}) 
Z{Ko;{Tij}) 



E 

{nj} 



(ij) 



Z{KT;{nj}) 



{2 cosh Kp)^B 



ZiKo;{nj}) 



(8) 



where Nb is the number of bonds on the lattice. All the quantities in this equation are 
invariant under the gauge transformation. After the summation over {crj} and division by 2^, 
we obtain^^' 



{G{{Tij}))Kr 



Z{KT;{Tij}) 
ZiKo;{rij}) 



Kp 



E 

{nj} 



{G{{n,}))KrZ{K,- {n,}) Z{Kt; {n,}) 



2^ (2 cosh iC^; 



Nb 



Z{Ko;{rij}) 



(9) 



It is useful to analyze here the quantity [(G({rij}))xj,]^ . Similarly to the above calculation, 
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the following identity can be derived by the gauge transformation, 

{G{{n,}))K,z{K,-{n,}) 



m{rij}))K^]K^ 



{Tij} 



2^ {2 cosh Kp)^B 



(10) 



Setting Kp = Kq in eq. (9) and Kp = Kt in eq. (10), we reach the following non-equilibrium 
relation, 

'2 cosh Kt\^'' 



J Ko 



2 cosh Ki 



(11) 



If we set GxiiTij}) = 1 in eq. (11), the Jarzynski equality for spin glass is obtained. 



-I3W\ 



I Ko^Kt 



2 cosh Kt 
2 cosh Kq 



Equation (12) leads to, using Jensen's inequality for the average of e 



2 cosh Kt 
2 cosh Kt) 



(12) 



(13) 



The right-hand side corresponds to AF in the Jarzynski equality in the usual representation. 
By substituting Gt({%}) = H into eq. (11), we obtain 



i7e-^^\ 

/ Ko^Kt 



Ko 



KtIKj 



2 cosh Kt 
T V 2 cosh Kn 



(14) 



This equation shows that the internal energy after the cooling or heating process starting from 
a temperature on the Nishimori line (NL),-^^' ^'''^ defined by i^' = Kp which is in the present 
case K = Kp = Kq, is proportional to the internal energy in the equilibrium state on the NL 
corresponding to the final temperature. 

It is straightforward to obtain a non-equilibrium relation for gauge-invariant quantities 
depending on the intermediate spin configurations, 



G({S})e- 



Ko^Kt 



Ko 



= [{Gr{{S}))KT^Ko]Kr 



2 cosh Kt Y^ 
2coshi^o / 



For instance, the autocorrelation function satisfies 



Si{0)Si{T)e-^'^) 



Kq^Kt 



Ko 



= [{SmSi{T))Kr^K,]Kr 



2 cosh Kt 
2 cosh Kn 



Nb 



(15) 



(16) 



This gives a non-trivial relation between the cooling and heating processes but with different 
amount of quenched randomness characterized by Kq and Kt- Let us consider the cooling 
process from a temperature on the NL given by {1/Kq, 1/Kq) to a point away from the NL 
{\/Kq, 1/Kt) as depicted by the downward arrow in Fig. 1. The above equation relates this 
process with the inverse process from a temperature on the NL {1/Kt, 1/Kt) to a point away 
from the NL {1/Kt, l/^o) drawn as the upward arrow in Fig. 1. The process of the upward 
arrow passes through the ferromagnetic and paramagnetic phases, whereas the cooling process 
goes through the spin glass phase. These apparently very different processes are related by 
eq. (16), which is a non-trivial observation. 
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Fig. 1. The processes of eq. (16) drawn as two arrows on the phase diagram. The sohd curves are 
the phase boundaries and the dashed hne of 45° represents the NL. 



We can establish another type of non-equiUbrium relation following Ozeki.^^^ We con- 
sider a non-equilibrium relaxation of the local magnetization {Si{T))^^^_^j^^, where F means 
that the initial state is So = (+1, +1, • • • , +!)• We evaluate the time evolution of the local 
magnetization as 

{S^inl^^j,^ = ^ 5.(r)eA*M(S„|S„.i;t„) . . . gAa/(Si|F;tO^ (17) 
{S} 

where At{<^ 1) is the unit time interval and M(S|S';t„) is the transition rate from state S' 
to state S following the master equation. The initial condition F is different from the case of 
non-equilibrium relations, where the equilibrium distribution is assumed initially. 
Let us apply the gauge transformation to (5'j(T))^^_^j^^/®) 

{Si{T)fK^^Kr = ^5iai(T)e^**^(^"l^"-i'*") •••e^**^(^il'^'*i). (18) 

{S} 

The configurational average for (5*4 (T))^^^^^ is thus 

[(5'i(r))|'g^j^j,]^^ 

^'^*^^^''^(2coshi^X^ ii"" ^ ^ -^^^^ 

If we set Kp = Kq and take the summation over all configurations of a, we obtain 

mm^^j,,]^^ = y: ^A^^i7^^^^(^)^^(o))^o^i..- (20) 

Since the autocorrelation function is gauge-invariant, the right-hand side can be shown to be 
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the configurational average using the same method as in eq. (10)/^-* 

[{Si{T)fKo^Kr]Ko = [{Si{0)SiiT))K,-,Kr]Ko ■ (21) 
Similarly we can prove that the autocorrelation function with the exponentiated work satisfies 



Ki 



{SmS^{T)e-^'^) 



Kt^Ko 



Kt 



Comparison of eqs. (16) (with Kt and Kq exchanged), (21) and (22) reveals 



[{S^{T)) 



Ko^Kt\ Kq 



(5,(r)e-'^^)?- 



2 cosh Kt 
Kt\'2 cosh Kq 



(22) 



(23) 



3.2 Gauge-non-invariant quantities 

As a typical gauge-non-invariant quantity, we choose Si{T) for O in eq. (5). After the 
configurational average, we have 



Si(T)e 



-pw\ 



I Ko^Kt 



{S^) 



i/Kr 



Z{KT;{Tij}) 

Z{Ko;{rij}) 



Gauge transformation for the right-hand side in this equation yields 



{Si) 



i/Kr 



Z{KT;{nj}) 



= E 



Z{KT;{Tij}) 
Z{Ko;{rij}) 



{ij) 



2 cosh K, 



(24) 



(25) 



p 



As usual, we sum both sides of this equation over all the possible configurations of a and 
divide the obtained quantity by 2^ to find 



{Si)KT 



Z{Ko;{Tij}) 



- E 2^(2coshi?>B ZiK^-{^}) ■ 



Z{KT;{n,}) 



The following relation can also be derived in a similar manner, 

Z{Kp;{n,}) 



[{Si)Ko. 



-{Si)Ko{'^i)Kp- 



Cp {2 cosh Kp)^B 

Setting Kp = Kq in eq. (26) and Kp = Kt in eq. (27), we find a relation 



(Si) 



zjKT-Anj}) - 

'ZiKo;{rij}). 
Thus a non-equilibrium relation results. 



{Si{T)e 



The same method yields 



Kq^Kt 



Ko 



2 cosh Kt 
2 cosh Kq 



2 cosh Kt 
2 cosh Ko 



(5o(r)5,(r)e-^^) 



Ko^Kt 



Ko 



f2coshKTY" 

iiS^^r)Ko]Kr[2cOshKj 



(26) 



(27) 



(28) 



(29) 



(30) 



Equations (29) and (30) relate the equilibrium physical quantities evaluated away from the 
NL (the right-hand sides) with other quantities measured by non-equilibrium processes from 
a point on the NL to another point away from the NL (the left-hand sides) as depicted in Fig. 
2. 
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Fig. 2. Equations (29) and (30) relate equilibrium physical quantities evaluated at a point 
{1/Kq, 1/Kt) (the lower-left dot in each panel) with other physical quantities evaluated by non- 
equilibrium processes shown in an arrow. The lower-left dot is in the spin glass phase whereas the 
corresponding arrow is in the ferromagnetic phase. 

4. Summary 

We have studied applications of non-equilibrium relations, typically the Jarzynski equality, 
to the context of spin glasses with gauge symmetry. It has been shown that the configurational 
average greatly simplifies a number of expressions appearing in non-equilibrium relations. In 
particular, the right-hand side of the Jarzynski equality, usually written as e~'^^^, reduces to 
a trivial analytic function of the initial and final temperatures, which has been used to prove 
a simple lower bound on the work. Many identities have also been derived for gauge-invariant 
and gauge-non-invariant quantities, which relate physical quantities measured at quite differ- 
ent environments. Most notably, the equilibrium values of the single-site magnetization and 
correlation function have been proved to be proportional to the non-equilibrium values of 
the corresponding quantities measured at different parts of the phase diagram. This result 
may possibly be useful to numerically evaluate equilibrium physical quantities in the spin 
glass phase from non-equilibrium calculations away from the spin glass phase with the aid of 
annealed importance sampling or population annealing method. ^"^^ 
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